Semi-automatic assessment of unrestrained Java code: a Library, a DSL, and a workbench to assess exams and exercises

© ACM 2015. This is the author's version of the work. It is posted here for your personal use. Not for redistribution. The definitive Version of Record was published in http://dx.doi.org/10.1145/2729094.2742615Automated marking of multiple-choice exams is of great interest in university courses with a large number of students. For this reason, it has been systematically implanted in almost all universities. Automatic assessment of source code is however less extended. There are several reasons for that. One reason is that almost all existing systems are based on output comparison with a gold standard. If the output is the expected, the code is correct. Otherwise, it is reported as wrong, even if there is only one typo in the code. Moreover, why it is wrong remains a mystery. In general, assessment tools treat the code as a black box, and they only assess the externally observable behavior. In this work we introduce a new code assessment method that also verifies properties of the code, thus allowing to mark the code even if it is only partially correct. We also report about the use of this system in a real university context, showing that the system automatically assesses around 50% of the work.This work has been partially supported by the EU (FEDER) and the Spanish Ministerio de Economíay Competitividad (Secretaría de Estado de Investigación, Desarrollo e Innovación) under grant TIN2013-44742-C4-1-R and by the Generalitat Valenciana under grant PROMETEOII2015/013. David Insa was partially supported by the Spanish Ministerio de Educación under FPU grant AP2010-4415.Insa Cabrera, D.; Silva, J. (2015). Semi-automatic assessment of unrestrained Java code: a Library, a DSL, and a workbench to assess exams and exercises. ACM. https://doi.org/10.1145/2729094.2742615SK. A Rahman and M. Jan Nordin. A review on the static analysis approach in the automated programming assessment systems. In National Conference on Programming 07, 2007.K. Ala-Mutka. A survey of automated assessment approaches for programming assignments. In Computer Science Education, volume 15, pages 83--102, 2005.C. Beierle, M. Kula, and M. Widera. Automatic analysis of programming assignments. In Proc. der 1. E-Learning Fachtagung Informatik (DeLFI '03), volume P-37, pages 144--153, 2003.J. Biggs and C. Tang. Teaching for Quality Learning at University : What the Student Does (3rd Edition). In Open University Press, 2007.P. Denny, A. Luxton-Reilly, E. Tempero, and J. Hendrickx. CodeWrite: Supporting student-driven practice of java. In Proceedings of the 42nd ACM technical symposium on Computer science education, pages 09--12, 2011.R. Hendriks. Automatic exam correction. 2012.P. Ihantola, T. Ahoniemi, V. Karavirta, and O. Seppala. Review of recent systems for automatic assessment of programming assignments. In Proceedings of the 10th Koli Calling International Conference on Computing Education Research, pages 86--93, 2010.H. Kitaya and U. Inoue. An online automated scoring system for Java programming assignments. In International Journal of Information and Education Technology, volume 6, pages 275--279, 2014.M.-J. Laakso, T. Salakoski, A. Korhonen, and L. Malmi. Automatic assessment of exercises for algorithms and data structures - a case study with TRAKLA2. In Proceedings of Kolin Kolistelut/Koli Calling - Fourth Finnish/Baltic Sea Conference on Computer Science Education, pages 28--36, 2004.Y. Liang, Q. Liu, J. Xu, and D. Wang. The recent development of automated programming assessment. In Computational Intelligence and Software Engineering, pages 1--5, 2009.K. A. Naudé, J. H. Greyling, and D. Vogts. Marking student programs using graph similarity. In Computers & Education, volume 54, pages 545--561, 2010.A. Pears, S. Seidman, C. Eney, P. Kinnunen, and L. Malmi. Constructing a core literature for computing education research. In SIGCSE Bulletin, volume 37, pages 152--161, 2005.F. Prados, I. Boada, J. Soler, and J. Poch. Automatic generation and correction of technical exercices. In International Conference on Engineering and Computer Education (ICECE 2005), 2005.M. Supic, K. Brkic, T. Hrkac, Z. Mihajlovic, and Z. Kalafatic. Automatic recognition of handwritten corrections for multiple-choice exam answer sheets. In Information and Communication Technology, Electronics and Microelectronics (MIPRO), pages 1136--1141, 2014.S. Tung, T. Lin, and Y. Lin. An exercise management system for teaching programming. In Journal of Software, 2013.T. Wang, X. Su, Y. Wang, and P. Ma. Semantic similarity-based grading of student programs. In Information and Software Technology, volume 49, pages 99--107, 2007

Network quantum steering

The development of large-scale quantum networks promises to bring a multitude of technological applications as well as shed light on foundational topics, such as quantum nonlocality. It is particularly interesting to consider scenarios where sources within the network are statistically independent, which leads to so-called network nonlocality, even when parties perform fixed measurements. Here we promote certain parties to be trusted and introduce the notion of network steering and network local hidden state (NLHS) models within this paradigm of independent sources. In one direction, we show how results from Bell nonlocality and quantum steering can be used to demonstrate network steering. We further show that it is a genuinely novel effect, by exhibiting unsteerable states that nevertheless demonstrate network steering, based upon entanglement swapping, yielding a form of activation. On the other hand, we provide no-go results for network steering in a large class of scenarios, by explicitly constructing NLHS models.Comment: 11 pages, 6 figure

The burden of breast, cervical, and colon and rectum cancer in the Balkan countries, 1990–2019 and forecast to 2030.

Background Despite effective prevention and control strategies, in countries of the Balkan region, cancers are the second leading cause of mortality, closely following circulatory system diseases. Objective To describe trends in the burden of breast, cervical, and colon and rectum cancer in the Balkan region and per country between 1990 and 2019, including a forecast to 2030. Methods We described the 2019 Global Burden of Disease (GBD) estimates for breast, cervical, and colon and rectum cancers in eleven Balkan countries over the period 1990–2019, including incidence, years lived with disability (YLD), years of life lost (YLL), and disability-adjusted life years (DALYs) rates per 100,000 population and accompanied 95% uncertainty interval. With the Autoregressive Integrated Moving Average, we forecasted these rates per country up to 2030. Results In the Balkan region, the highest incidence and DALYs rates in the study period were for colon and rectum, and breast cancers. Over the study period, the DALYs rates for breast cancer per 100,000 population were the highest in Serbia (reaching 670.84 in 2019) but the lowest in Albania (reaching 271.24 in 2019). In 2019, the highest incidence of breast cancer (85 /100,000) and highest YLD rate (64 /100,000) were observed in Greece. Romania had the highest incidence rates, YLD rates, DALY rates, and YLL rates of cervical cancer, with respective 20.59%, 23.39% 4.00%, and 3.47% increases for the 1990/2019 period, and the highest forecasted burden for cervical cancer in 2030. The highest incidence rates, YLD rates and DALY rates of colon and rectum cancers were continuously recorded in Croatia (an increase of 130.75%, 48.23%, and 63.28%, respectively), while the highest YLL rates were in Bulgaria (an increase of 63.85%). The YLL rates due to colon and rectum cancers are forecasted to progress by 2030 in all Balkan countries. Conclusion As most of the DALYs burden for breast, cervical, and colon and rectum cancer is due to premature mortality, the numerous country-specific barriers to cancer early detection and quality and care continuum should be a public priority of multi-stakeholder collaboration in the Balkan region

Additional file 2: of Do health care workforce, population, and service provision significantly contribute to the total health expenditure? An econometric analysis of Serbia

Cross-correlation analysis and lag of variables. (DOC 80 kb

Additional file 3: of Do health care workforce, population, and service provision significantly contribute to the total health expenditure? An econometric analysis of Serbia

Testing a unit root of the time series. (DOC 240 kb